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Abstract 

Most neurons in peripheral sensory pathways initially respond vigorously when a preferred stimulus 
is presented, but adapt as stimulation continues. It is unclear how this phenomenon affects stimulus 
representation in the later stages of cortical sensory processing. Here, we show that a temporally sparse 
and reliable stimulus representation develops naturally in a network with adapting neurons. We find 
that cellular adaptation plays a critical role in the transient reduction of the trial-by-trial variability of 
cortical spiking, providing an explanation for a wide-spread and hitherto unexplained phenomenon by a 
simple mechanism. In insect olfaction, cellular adaptation is sufficient to explain the emergence of the 
temporally sparse and reliable stimulus representation in the mushroom body, independent of inhibitory 
mechanisms. Our results reveal a computational principle that relates neuronal firing rate adaptation 
to temporal sparse coding and variability suppression in nervous systems with a sequential processing 
architecture. 



Introduction 

The phenomenon of spike-frequency adaptation (SFA) [Tl (also known as spike-rate adaptation) is a 
fundamental process in nervous systems, which attenuates the neuronal stimulus responses to a lower level 
following an initial high firing. This process can be mediated by different cell-intrinsic mechanisms that 



involve a spike-triggered self-inhibition, and which can operate in a wide range of time scales 3|25 . These 



processes are probably related to the early evolution of the excitable membrane 36[38 and are common to 
vertebrate and invertebrate neurons, both in the peripheral and central nervous system 49 . Nonetheless, 
the functional consequences of SFA in peripheral stages of sensory processing on the representation of 
stimuli in later network stages remain unclear. For instance, while olfactory stimuli generally display a 



slow kinetics, the early olfactory system shows temporally adaptive and precise onset responses 19 40 
that may translate into narrow integration windows for the principal neurons in the next processing stage, 
the piriform cortex pyramidal cells in rodents |35j and the mushroom body Kenyon cells in insects [34] . 
However, it remains unclear how sparse single-neuron responses can reliably encode information in face 
of the response variability 'IT and the sensitivity of cortical networks to small perturbations U . 

Here, we show that the SFA mechanism introduces a dynamical non-linearity in the transfer function 
of neurons. Subsequently, the response onset becomes progressively sparser when transmitted across 
successive processing stages. Additionally, the self-regulating effect of SFA causes a stimulus-triggered 
reduction of firing variability by modulating the average inhibition in the balanced cortical network. In 
this manner the temporally sparse representation is accompanied by an increased response reliability. Us- 
ing this theoretical framework on data obtained from the olfactory system of the honeybee, we show that 
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Figure 1. Neuronal adaptation in the multi-stage processing network. (A) Schematic 
illustration of a three-layered model of an adaptive pathway of sensory processing. The network consists 
of three consecutive adaptive populations. Each population receives sensory input from an afferent 
source (black arrows) and independent constant background excitation (dashed arrow). Input is 
modeled by a Gaussian density and a sensory stimulus presented to the first population is modeled by 
an increase in the mean input value. (B) Response profiles. The evoked state consists of a phasic-tonic 
response in all populations. The tonic response level is decremented across the consequtive populations. 
(C) Temporal sparseness is measured by the integral over the firing rate and normalized by the 
average spike count at t = 500 ms in the first population. Responses become progressively sparser as the 
stimulus propagates into the network. (D) Secondary response profiles. The additional jump increase in 
stimulus strength at t = 1000 ms during the evoked state of the first stimulus results in a secondary 
phasic response in all populations with an amplitude overshoot in the 2nd and 3rd population. 



the sequential effect of the SFA shapes the Kenyon cells' temporal sparseness independent of inhibitory 
synaptic mechanisms. 

Our results reveal a generic, biophysically plausible mechanism that can explain the emergence of a 
reliable and sparse stimulus representation, indicating the importance of cellular adaptation in sensory 
computation at the network level. 



RESULTS 

Temporal sparseness emerges in successive adapting populations 

To examine how successive adapting populations can achieve temporal sparseness, first we mathematically 
analyzed a sequence of neuronal ensembles (Figure 1 A) , where each ensemble exhibits a generic model 
of mean firing rate adaptation by means of a slow negative self-feedback [3 



22 29^ (Materials and 
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Methods). This sequence of neuronal ensembles should be viewed as caricature for distinct stages in 
the pathway of sensory processing. For instance in the mammalian olfactory system the sensory pathway 
involves several stages from the olfactory sensory neurons to the olfactory bulb, the piriform cortex, and 
then to higher cortical areas (Figure lA). 

The mean firing rate in the steady-state of a single adaptive population can be obtained by solving 
the rate consistency equation, = f{^i — TsQsrilo'f), where f is the equilibrium mean firing rate of the 
population i, /i^ and af are mean and variance of the total input into the population, respectively, / 
is the response function (input-output transfer function, or //-curve) of the population mean activity, 
Qs is the quantal conductance of the adaptation mechanism per unit of firing rate, and Ts is the firing 
rate relaxation time constant [3j22 29 . It is known that any sufficiently slow modulation {l/vmax < ^s) 
linearizes the steady-state solution, fi , due to the self- inhibitory feedback being proportional to the firing 
rate [10, . 

Here, for simplicity, we studied the case where all populations in the network exhibit the same initial 
steady-state rate. This is achieved by adjustment of a constant background input to population i (doted 
arrows. Figure lA), resembling the stimulus irrelevant interactions in the network. All populations are 
coupled by the same strength g. First, we calculated the average firing rate dynamics of the populations' 
responses following a step increase in the mean input to the first layer (black arrow. Figure lA). By 
solving the dynamics of the mean firing rate and adaptation level concurrently, we obtained the mean- 
field approximation of the populations' firing rates (Materials and Methods). The responses of each 
population consisted of a phasic and a tonic part, typical for adapting neurons. Here, we plotted the mean 
firing rate of three consecutive populations (Figure IB). The phasic response to a step increase in the 
input is presented across stages. However, the tonic response becomes increasingly suppressed in the later 
stages (Figure IB). This phenomenon is a general feature of successive adaptive neuronal populations. 
To understand why the tonic response part, after the adaptation was reinstalled, is increasingly suppressed 
in later stages we used the linearity of the adaptive transfer function and its stability conditions at the 



steady-state 10 . Thus, a change in the mean rate of population i is the solution of Afi = f{gAfi-i — 
AfiTgqs), and since the transfer function, /, is assumed to be increasing and the slope of f is less 
than unity, the solution can only existe for Afi_i > Af; (Materials and Methods). The result in 
this sub-section (Figure IB-C) was established with a current based leaky integrated-and-fire response 
function. However, the analysis presented here extends to the majority of neuronal transfer functions 



since the stability and linearity of the adapted steady-states are granted 10 22 . This simple effect 



leads to a progressively sparser representation across successive stage of a generic feed-forward adaptive 
processing. We quantified the temporal sparseness by S^T) = ri{t)dt^ where ri{t) is the mean firing 
rate of population i and T is the observation time window. Normalization of this measure by the first 
population Sl{T = 500) indicates sparser responses in later stages of the adaptive network (Figure IC). 

Does the suppression of the adapted response level impair the information about the presence of the 
stimulus? To explore this, we studied a secondary increase in stimulus strengths of equal magnitude after 
1 second when the network has relaxed to the evoked equilibrium (Figure ID). The secondary stimulus 
jump induced a secondary phasic response of comparable magnitude in the first population (Figure ID). 
However, in the later populations this jump evoked an icreased peak rate in the phasic response (Figure 
ID). Notably, the coupling factor g between the populations shapes this phenomena. Here, we adjusted 
g to achieve an equal onset response magnitude across the populations for the first stimulus jump at 
t = 0, and a slight increase in the population onset response in the first population is amplified in the 
later stages. This is due to the fact that the later stages accumulated less adaptation in their evoked 
steady-state (level of adaption is proportional to mean firing rate). Importantly, this result confirms 
that the sustained presence of the stimulus is indeed stored in the level of cellular adaptation 32 , even 



though it is not reflected in the firing rate of the last population. Therefore, regardless of the absolute 
amplitude of responses, the relative relation between secondary and initial onset keeps increasing across 
layers. This type of a secondary overshoot is also experimentally known as sensory sensitization, where 
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an additional increase in the stimulus strength significantly enhances the responsiveness of later stages 
after the network converged to an adapted steady-state |18j . 

Adaptation increases response reliability in the cortical network 

The mean firing rate approach as above is insufficient to determine how reliable the observed response 
transients are across repeated stimulations. In the prevailing spiking network model of the cortex, the bal- 
ance of excitation and inhibition is quickly reinstalled within milliseconds after the onset of an excitatory 



input 47 and self-generating recurrent fluctuations strongly dominate the dynamics of the interactions. 



It has thus been questioned whether a sparse response of only very few action potentials could reliably 



encode the presence of a stimulus 24 



To investigate the reliability of adaptive mapping from a dense stimulus to a sparse cortical spkie 
response across successive processing stages we employed an adaptive population density formalisms 
29] (Materials and Methods) along with numerical network simulations. We embeded a two- 
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layered sensory network with an afferent ensemble projecting to a cortical network (Figure 2A). The 
afferent ensemble consisted of 4,000 adaptive neurons that included voltage dynamics, conductance-based 
synapses, and spike-induced adaptation [29j. It resembles the sub-cortical sensory processing and each 
neuron in the afferent ensemble projects to randomly 1% of the neurons in the cortical network. This is 
a large circuit of the balanced network (Figure 2A) with 10,000 excitatory and 2,500 inhibitory neurons 
with a typical random diluted connectivity of 1%. The spiking neuron model in the cortical network 



again includes voltage dynamics, conductance-based synapses, and spike-induced adaptation 29 . All 



neurons are alike and parameters are given in Table. 3 in MuUer et al. 29 . With appropriate adjustment 



of the synaptic weights, the cortical network operates in a globally balanced manner, producing irregular, 



asynchronous activity 20 47 48 . The distribution of firing rates for the network approximates a power- 
law density 37 with an average firing rate of « 3.0 Hz (Figure 2B) and the coefficients of variation (Ct,) 
for the inter-spike intervals is centered at a value slightly greater than unity (Figure 2C) indicating the 
globally balanced and irregular state of the network [48]. Noteworthy, the activity of neurons in both 
stages is fairly incoherent and spiking in each sub- network is independent. Therefore, one can apply an 
adiabatic elimination of the fast variables and formulate a population density description where a detailed 



neuron model reduces to a stochastic point process TT])29j that provides an analytical approximation and 



understanding of the simulation results in this section (Materials and Methods). 

The background input is modeled as a set of independent Poisson processes that drive both sub- 
networks (dashed arrows. Figure 2A). The stimulus dependent input is an increase in the intensity of 
the Poisson input into the afferent ensemble (solid arrow. Figure 2A). Before the stimulus became active 
at time t = 0, a typical neuron showed an irregular spiking activity in both network stages (Figure 2B- 
D). However, when a sufficiently strong stimulus is applied, neurons in both stages exhibited a transient 
response before the population mean firing rate converges back to a new level of steady-state (Figure 
2D,E). The population firing rate in the numerical simulations (solid line. Figure 2E) follow well the 
adaptive population density treatment (filled circles. Figure 2E). 

To measure the effect of neuronal adaptation on the temporal sparseness, we again computed the 
number of spikes per neuron after the stimulus onset, Se{T). We compare our standard adaptive network 
with an adaptation time constant of = 110ms (solid lines, Figure 2F) with an only weakly-adaptive 
control network (r^ =30ms; dashed lines. Figure 2F). Note, that the adaptation time constant in the 
weakly adaptive network is about equal to the membrane time constant and therefore plays a minor role 
for the network dynamics. It showed that both sub-networks generated sharp phasic response, which in 
the case of the cortical network evoked a single sharply timed spike within the first ss 10 — 20 ms in a 
subset of neurons (Figure 2B,F). In the control case, the response is non-sparse and response spikes are 
distrubuted throughout the stimulus period (dashed lines. Figure 2F). Overall, strong adaptation reduces 
the total number of stimulus-induced action potentials per neuron and concentrates their occurrence 
within an initial brief phase following fast changes in the stimulus. Thus, in accordance with the results 



5 



of the rate-based model in the previous section, one can conclude that the sequential stimulation of 
adaptive network stages can account for the emergence of a sparse stimulus representation in a cortical 
population. 

To reveal the effect of adaptation on the response variability, we employed the time-resolved Fano 
factor [31] , F, which measures the spike-count variance divided by the mean spike count across 200 
repeated stimulations. Spikes were counted in a 50ms time window and a sliding of 10ms |9 . As before, we 
compared our standard adaptive network (Figure 2G,I; = 110ms) with the control network (Figure 
2H,J; rs=30ms). Since the Fano factor is known to be strongly dependent on the firing rate, we adjusted 
the input to the latter such that the steady state firing rates in both networks were mean- matched [9^. 
The input Poisson spike trains {F — 1) translated into slightly more regular spontaneous {t < 0) activity 
in the afferent ensemble (Figure 2G), as neuronal membrane filtering and refractoriness reduced the 
output variability. After the stimulus onset (t = 0), due to the increase in the mean input rate, the 
average firing rate increased, however the variance of the number of events per trial did not increase 
proportionally. Therefore, we observed a reduction in the Fano factor (Figure 2G). This phenomena 
is independent of the adaptation mechanism in the neuron model and a quantitatively similar reduction 
can be observed in the weakly adaptive afferent ensemble (Figure 2H). A comparison between our 
standard adaptive and the control case reveals that the adaptive network is generally more regular in the 
background and in the evoked state (Figure 2G,H). This is due to the previously known effect, where 
adaptation induces negative serial correlations in the inter-spike intervals [SJfTT] and as a result reduces 
the Fano factor [7 11 



In the next stage of processing, the distribution of F across neurons during spontaneous activity is 



high due to the self-generated noise of the balanced circuits 23 , 47 . This closely follows a wide spread 
experimental finding where F > 1 in the spontaneous cortical activity [9] ( Figure 2G,H). Whenever 
a sufficiently strong stimulus was applied, the internally generated fluctuations in the adaptive balanced 
network were transiently suppressed, and as a result the Fano factor dropped sharply (Figure 21). 
However, this reduction of the Fano factor is a temporary phenomenon and F converges back to slightly 
above the baseline variability (Figure 21). At the same time, the evoked steady-state firing returned back 
to the irregular and asynchronous state (Figure 2D). Indeed, this effect corresponds to a temporally 
mis-match in the balanced input conditions to the cortical neurons since the self-inhibitory and slower 
adaption effect prevents a rapid adjustment to the new input regime. This can be observed in the time 
course of variability suppression that closely reflects the time constant of adaptation (Figure 21) . The 
afferent ensemble structured the input to the cortical ensemble, determining the magnitude of the observed 
reduction effect, and under the control condition where a pure Poisson input is provided to the cortical 
balanced network, the reduction in F is reduced but the time scale of recovery remains unaltered (crosses. 
Figure 21). We contrast this adaptive behavior with the variability dynamics in the weakly adaptive 
balanced network (Figure 2J). In this case there is no reduction in F, because for a short adaptation 
time constant the convergence to the balanced state is very rapid [47]. The small increase in the input 



noise strength leads to an increase of the self-generated randomness of the balanced network 23 28 



To further understand the effect of the recurrent connectivity on the variability, one can compare 
the evoked variability between the afferent ensemble and the cortical network. In the latter, fluctuation 
intrinsic to the cortical networks dynamically bring back the cortical circuits to the spontaneous level 
of high variability within the time scale of adaption relaxation (Figure 21) . This suggests the transient 
suppression of variability during a stimulus response as a cortical- wide effect [9j could be caused by slow 
adjustment of self-regulatory feedback. 
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Adaptive networks generate sparse and reliable responses in the insect olfac- 
tory system 

As a case study, we investigated the role of adaptation for the emergence of the sparse temporal code 
in the insects olfactory system, which is analogoue to the mammalian olfactory system. We simulated a 



reduced generic model of olfactory processing in insects using the adaptive neuron model 29 . The model 
network consisted of an input layer with 1,480 olfactory sensory neurons (OSNs), which project to the 
next layer representing the antennal lobe circuit with 24 projection neurons (PNs) and 96 inhibitory local 
inter-neurons (LNs) that form a local feed-forward inhibitory micro-circuit with the PNs. The third layer 
holds 1,000 Kenyon cells (KCs) receiving divergent-convergent input from PNs. The relative numbers 



for all neurons approximate the anatomical ratios found in the olfactory pathway of the honeybee 27 
(Figure 3A) . We introduced heterogeneity among neurons by randomizing their synaptic time constants 
and the connectivity probabilities are chosen according to anatomical studies. Synaptic weights were 
adjusted to achieve spontaneous firing statistics that match the observed physiological regimes. The SFA 
parameters were identical throughout the network with = 110 ms (sec Materials and Methods for 
details) . 

Using this model, we sought to understand how adaptation contributes to temporally sparse odor 
representations in the KC layer in a small sized network and under highly fluctuating input conditions. We 
simulated the input to each OSN by an independent Poisson process, which is thought to be reminiscent 



of the transduction process at the olfactory receptor level 30 . Stimulus activation was modeled by a step 
increase in the Poisson intensity with uniformly jittered onset across the OSN population (Materials 
and Methods). Following a transient onset response the OSNs adapted their firing to a new steady-state 
(Figure 3B,C). The pronounced effect of adaptation becomes apparent when the adaptive population 
response is compared to the OSN responses in the control network without any adaptation (ts=0; dashed 
line. Figure 3C). In the next layer, the PN population activity is reflected in a dominant phasic-tonic 
response profile (green line. Figure 3D), which closely matches the experimental observation |19 . This 
is due to the self-inhibitory effect of the SFA mechanism, and to the feedforward inhibition received 
from the LNs (magenta line. Figure 3D). Consequently, the KCs in the third layer produced only very 
few action potentials following the response onset (red line , Figure 3E,G). The average number of 
emitted KC response spikes per neuron, S'e, is small in the adaptive network (average < 2) whereas 
KCs continue spiking throughout stimulus presentation in the non-adaptive network (Figure 3G). This 
finding closely resembles experimental findings of temporal sparseness of KC responses in different insect 
species 6 p4p3 and quantitatively matches the KC response statistics provided by Ito and colleagues 15 . 
The simulation results obtained here confirm the mathematically derived results in the first results section 
(Figure 1) and show that neuronal adaption can cause a temporal sparse representation even in a fairly 
small and highly structured layered network where the mathematical assumptions of infinite network size 
and fundamentally incoherent activity are not full filled. 

To test the effect of inhibition in the LN-PN micro-circuitry within the antennal lobe layer on the 
emergence of temporal sparseness in the KC layer, we deactivated all LN-PN feedforward connections 
and kept all other parameters fix. We found a profound increase in the amplitude of the KC popu- 
lation response, both in the adaptive (red line, Figure 3F) and the non-adaptive network (dashed red 
line, Figure 3F). This increase in response amplitude is carried by an increase in the number of respond- 
ing KCs due to the increased excitatory input from the PNs, implying a strong reduction in the KC 
population sparseness. Importantly, removing local inhibition did not alter the temporal profile of the 
KC population response in the adaptive network (cf. red lines in Figure 3E,F), and thus temporal 
sparseness was independent of inhibition in our network model. 

How reliable is the sparse spike response across trials in single KCs? To answer this question, we 
again measured the robustness of the stimulus representation by estimating the Fano factor across 200 
simulation trials (Figure 3H). The network with adaptive neurons and inhibitory micro-circuitry ex- 
hibited a low Fano factor (median « 0.3) and a narrow distribution across all neurons. This follows the 
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experimental finding that the few spikes emitted by KCs are highly reliably [Ts] (network 1, Figure 3H). 
Turning ofi' the inhibitory micro-circuitry did not significantly change the response reliability (Wilcoxon 
rank sum test, p-value — 0.01; network 2, Figure 3H). However, both networks that lacked adaptation 
exhibited a significantly increased variability with a median Fano factor close to one (Wilcoxon rank sum 
test, p-value = 0.01; networks 3 and 4, Figure 3H), independent of the presence or absence of inhibition 
within the antennal lobe. 

To explore whether neuronal adaptation could be the responsible mechanism for temporal sparseness 
in the biological network, we performed a set of Calcium imaging experiments, monitoring Calcium 
responses in the KC population of the honeybee mushroom body [43_ (Materials and Methods). Our 
computational model (Figure 3) predicted that blocking of the inhibitory microcircuit would increase 
the population response amplitude but should not alter the temporal dynamics of the KC population 
response. In a set of experiments, we tested this hypothesis by comparison of the KCs' evoked activity 
in the presence and absence of GABAergic inhibition (Materials and Methods). First, we analyzed 
the normalized Calcium response signal within the mushroom body lip region in response to a 3s, 2s, 
Is and 0.5s odor stimulus (Figure 4A). We observed the same brief phasic response following stimulus 
onset in all four cases with a characteristic slope of Calcium response decay that has been reported 
previously fiS^. Bath application of the GABA^i antagonist picrotoxin (PTX) did not change the time 
course of the Calcium response dynamics (Figure 4B-D). The effectiveness of the drug was verified by 
the increased population response amplitude in initial phase (Figure 4C). Next, we tested the GABA^ 
antagonist hydrochloride (CGP) using the same protocol and again found an increase in the response 
magnitude but no alteration of the response dynamics (Figure 4E,F). 



DISCUSSION 



We here propose that a simple neuron-intrinsic mechanism of spike-triggered adaptation can account for 
a reliable and temporally sparse sensory stimulus representation across stages of sensory processing. At 
the single neuron level SFA is known to induce the functional property of a fractional differentiation with 
respect to the temporal profile of the input and thus offers the possibility of tuning the neuron's response 
properties to the relevant stimulus time-scales at the cellular level [3][4j|25]. Our results indicate that 
a sensory processing in a feedforeward network with adaptive neurons focuses on the temporal changes 
of the sensory input in a precise and temporally sparse manner (Figure IB; Figure 2E and Figure 
3E). At the same time the constancy of the stimulus is memorized in the cellular level of adaptation 32 
(Figure ID). We hypothesize that at later processing stages in the sensory pathway, notably in the 
sensory cortices and in the insect mushroom body, it is most relevant to encode and process relevant 
dynamic changes in the sensory environment and to neglect the static stimulus features as well as the 
dynamic fiuctuations of receptor sensations present at very fast time scales. One prominent example is 
primate vision where, in the absence of the self-generated dynamics of retina input due to microsaccades. 



observers become functionally blind to stationary objects during fixations 26 



The emergence of a sparse representation has been demonstrated in various cortical sensory areas, for 
auditory 



example in visual 44 



14 



, somatosensory 16 , and olfactory 35 cortices, and thus manifests 



a principle of sensory computation across sensory modalities and independent of the natural stimulus 
kinetic. However, it has been repeatedly questioned whether a few informative spikes can survive in 
the cortical network, which is highly sensitive to small perturbations 24 50 . Our results show that 



a biologically realistic cellular mechanism implemented at successive network stages can transform a 
dense and highly variable Poisson input at the periphery into a sparse and highly reliable ensemble 
representation in the cortical network. These results refiect previous theoretical evidence that SFA has 
an extensive synchronizing-desynchronizing effect on population responses in a balanced network 46 



However, cellular adaptation has largely been neglected in theory and simulation of cortical networks. 



with very few exceptions 46 , although it facilitates a transition from a dense rate code to a temporal 
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code expressed in the concerted spiking of cortical cell assemblies [21] (Figure 2D). 

Importantly, the adaption level adjusts with a dynamics that is slow compared to the dynamics 
of excitatoary and inhibitory synaptic inputs. This circumstance allows for a transient mismatch of 
the balanced state in the cortical network and thus leads to a transient reduction of the self-generated 
(recurrent) noise (Figure 21). This, in turn, explains why the temporally sparse representation can 
be highly reliable. This result seems counter-intuitive in the light of previous studies that consistently 



stressed the persistence of noise in the balanced network 23 24 28 . However, cellular adaptation has 
largely been neglected in theory and simulation of cortical networks with very few exceptions 46 . 

Our results provide an understanding of the role of slow cellular adaptation dynamics for the transient 
suppression of the trial-by-trial response variability. We thus arrived at a coherent model explanation 
for the previously unexplained and wide-spread experimental phenomenon of a stimulus-driven transient 
reduction of response variability in cortical neurons, which has been observed in different species and 
across many cortical areas, from occipital to frontal, as e.g. reported by Churchland and colleagues for 
14 independent datasets |9]. 

The insect olfactory system is experimentally well investigated and examplifies a pronounced sparse 
coding scheme at the level of the mushroom body KCs. The olfactory system is analog in invertebrates 
and vertebrates and the sparse stimulus representation is likewise observed in the pyramidal cells of the 



piriform cortex I35i , and the rapid responses in the mitral cells in the olfactory bulb 40 compare to those 



of projection neurons in antennal lobe 19 . Our adaptive network model, designed in coarse analogy to the 
insect olfactory system, produced increasingly phasic population responses as the stimulus-driven acitivty 
propagated through the network. Our model results closely match the repeated experimental observation 



of temporally sparse KG responses in extracellular recordings from the locust 34 and manduca 6 15 



and in Calcium imaging in the honeybee 43 



In our experiments we could show that systemic blocking of GABAergic transmission did not affect the 
temporal sparseness of the KG population response in the honeybee (Figure 4). This result might seem to 
contradict former studies that stressed the role of inhibitory feed-forward [2] or feedback inhibition 13p3 



for the emergence of KG sparseness. However, the suggested inhibitory mechanisms and the sequential 
effect in the adaptive network proposed here are not mutually exclusive and may act in concert to establish 
and maintain a temporal and spatial sparse code in a rich and dynamic natural olfactory scene. 

The adaptive network model manifests a low trial-to-trial variability of the sparse KG responses that 
typically consist of only 1-2 spikes. In consequence, a sparsly activated KG ensemble is able to robustly 
encode stimulus information. The low variability at the single cell level (Figure 3H) carries over to a low 
variability of the population response [llj . This benefits downstream processing in the mushroom body 
output neurons that integrate converging input from many KGs [27|, and which were shown to reliably 



encode odor-reward associations in the honeybee 42 



Our results here bear consequences of general importance for sensory coding theories. A mechanism of 
self-inhibition at the cellular level can facilitate a temporally sparse ensemble code but does not require a 
well adjusted interplay between the excitatory and inhibitory circuitry at the network level. This network 
effect is robust due to the distributed nature of the underlying mechanism, which acts independently in 
each single neuron. The regularizing effect of self-inhibition increases the signal-to-noise ratio not only of 



single neuron responses but also of the neuronal population activity 11 that is postsynaptically integrated 
in downstream neurons. 

Materials and Methods 

Rate model of generic feedforward adaptive network 

To address analytically the sequential effect of adaptation in a feedforward network, we consider a model 
in which populations are described by their firing rates. Although firing rate models typically provide a 
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fairly accurate description of network behavior when the neurons are firing asynchronously 45 , they do 
not capture all features of realistic networks. Therefore, we verify all of our predictions with a population 
density formalism ^^T\ as well as a large-scale simulation of realistic spiking neurons. To determine the 
mean activity dynamics of a consecutive populations, we employed an standard mean firing rate model 
of population i as 

^'ri^-n + f{gr,^l+fli-a^\ai) 
\di = -^flj + riQs 

where / is the transfer input-output function, is the adaptation time-scale, g is the coupling factor 
between two populations and a is the adaptive negative feedback for the population i with strength 
and a is the standard deviation of the input. For simplicity we define = gr^-i + ^i. Given / the 
equilibrium can be determined by 

fi = f(mi-Tsqsfi\ai). (2) 



This fix point is always stable 22 and the condition for the stability reads dr^f{m — Tsqsri\ai)\f^ < 1 



and 9„j./(m — Tsqs'fi\ai)\f < 0. It is also known that the is a linear function, given a sufficiently slow 



adaptation Ts and a non-linear shape of / 10 . Thus, if r^-i = in two subsequent populations, and 
increased input to population i — 1 leads to smaller increase for next population i and the adapted level 
of responses satisfy Ar^-i > Ar^. 

The stimilus onset response lies between the adapted steady-state and not adapted responses function 
/ given the level of new input and can be analytical calculated accordingly [s]. 

Population density approach to the adaptive neuronal ensemble 

In MuUer et al. [29| it is shown that by an adiabatic elimination of fast variables a detailed neuron 
model including voltage dynamics, conductance-based synapses, and spike-induced adaptation reduces 
to a stochastic point process. Thus, we define an orderly point process with a hazard function argument 
with state variable x as 

K(.,t):= hm P^m,t + At)>OM^ 

At-i.O+ At 

where N[t, t + At) is the number of events in At. We assume the dynamic of the adaptation variable is 

X = -—x + ^S{t-tk)qs, (4) 
k 

where t^ is the time of fcth spike in the ensemble. Thus, the state variable distribution at time t in the 
ensemble is governed by a master equation of the form 



dtPr{x,t) - -9, 



— Pr(a;,i) 



+ hx{x - qs,t) Pr(a; - qs,t) 



- K{x,t)PT{x,t). (5) 

We solve the Eq.Jslwith the help of the transformations tg = ri{x) :~ ~T\og{x/q) and ip{ts) — r]{ri^^{ts + 
q)) numerically [29| . It turns out that indeed is the input-out transfer function of neurons in the 
network where its instantaneous parameters are give by the input statistics [29|. Here, we used the mean- 



field formalism developed by Lcchner et al. 23 to approximately determine the averaged input within a 
standard balanced network, as the parameters of the hazard function h^. Therefore, the functional form 
of its solution in a compact form is 

PT(ts\t) = ktn{ts\t) (6) 
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where is the initial condition state of the system and kt is a constant defined by J Pr{ts\t)dts = 1. 
Hence, it can be shown that the firing rate and the consistency equation of the ensemble is 

/oo 
ht^{ts\t)Pl{ts\t)dts. (7) 
-oo 

Now, by applying the techniques in Farkhooi et al fill, we define a joint probabihty density as 

Pn{tn,t^\t°,t) (8) 

where an n"' event occurs at time tn > t and the state variable is t" . We can write n + 1*^ event time 
and state of adaptation joint density recursively 

Pn+,it^+,,t:+'\ct) ^ J J pit„+,-t„,t:^'\t:,t)put„,t:\tit)dt„dt: (9) 

To simplify the integral equations, we use Bra-Ket notation and thereafter, we derive the Laplace trans- 
form of the joint density by 

p„+i (s, t:+'\ti t) = ti\ti, t)\p{s, t:+' \t^,t)) (10) 

where pi{ti,tl\t^,t) — p{ti,tl.\t'^,t) Next, we define the operator P„(s|t), 

Pn{s\t) = (1 I P„(s|i) I Pr{ts,t)) = (1 I P"(s|t) I Pr{t^,t)). (11) 

Now, by employing P{l,s\t) — 1/ {fiis'^)[p2{s\t) — 2pi(s|t) + 1] as in fll], we derive 

P{n, s\t) = l/{pis^)[p,,+i{s\t) ~ 2p„(s|t) + p„_i(s|0], (12) 

where P(n, s\t) is the Laplace transform of the probability density of observing n events in a given time 
window. Now we derive 

As\t^EkPk(Mt) = (1 I P{s\t)/{I-P{s\t)) I PT{s\t)) (13) 

where I is the identity operator. This equation represents the Laplace transfom of the autocorrelation 
function. Thus, the Fano factor is Js\t = ^1 Pis^ — (1 + 2As\t) and the inverse Laplace transform is 

Jti* = 1 + (2/r) / [T~u)A[u\t)du~Tru (14) 
Jo 

where A{u\t) = C^^[As\t]- 

Computational model of insect olfactory coding 

Our model neuron is a general conductance-based integrate-and-fire neuron with spike-frequency adap- 
tation as it is proposed in MuUer et al. 29 . The model phenomenologically captures a wide array of 
biophysical spike-frequency mechanisms such as M-type current, afterhyperpolarization (AHP-current) 
and even slow recovery from inactivation of the fast sodium current 29 . The model neuron is also known 
to perform high-pass filtering of the input frequencies following the universal model of adaptation [sj. 
Neuron parameters used follow the Table. 3 in MuUer et al. 29 The conductance model used for the static 
synapses between the neurons is alpha-shaped with gamma distributed time constants from r(2.5, 4) and 
r(5,4) for excitatory and inhibitory synapses, respectively. All simulations were performed using the 
NEST simulator 12 version 2.0beta and the Pynest interface. 
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The network connectivity is straight forward: each PN and LN receives excitatory connections from 
20% randomly chosen OSNs (8ll39]. Additionally, every PN receives input from 50% randomly chosen 



inhibitory LNs j8j|39j. In our model the PNs do not excite one another and each PN output diverges to 



50% randomly chosen KCs [2l[l7lp 

We tuned the simulated network by adjusting the synaptic weights to achieve the same spontaneous 
firing rate as reported experimentally: OSNs 15-25Hz LNs 4-lOHz [8j, PNs 3-10 [l9j and KCs 

0.3-1. OHz fill. 



Experimental methods 

Experiments were performed following the methods published in Szyszka et al |43 . In summary, foraging 
honeybees {Apis mellifera) were caught at the entrance of the hive, immobilized by chilling on ice, and 
fixed in a plexiglas chamber before the head capsule was opened for dye injection. We retrogradely stained 
clawed Kenyon cells (KG) of the median calyx, using the calcium sensor FURA-2 dextran (Molecular 
Probes, Eugene, USA) with a dye loaded glass electrode, which was pricked into KG axons projecting to 
the ventral median part of the a-lobe [43]. After dye injection the head capsule was closed, bees feed and 
kept in a dark humid chamber for several hours. 

The processing of imaging data was performed with custom written routines in IDL (RSI, Boulder, 
GO, USA). In summary, changes in the calcium concentration were measured as absolute changes of 
fluorescence: a ratio was calculated from the light intensities measured at 340nm and 380nm illumination 
and the background fluorescence before odor onset was subtracted leading to AF with F = F340/F380. 
Odor stimulation was preformed under a 20x objective of the microscope, the naturally occurring plant 
odor octanol (Sigma Aldrich, Germany), diluted 1:100 in paraffine oil (FLUKA, Buchs, Switzerland), was 
delivered to both antennae of the bee using a computer controlled, custom made olfactometer. To this, 
odor loaded air was injected into a permanent airstream resulting in a further 1:10 dilution. Stimulus 
duration was 3 seconds if not mentioned otherwise. The air was permanently exhausted. 

For GABA blockage, a solution of 150 /j,l GABA receptor antagonist dissolved in ringer for final 
concentration (lO'^M picrotoxin (PTX, Sigma Aldrich, Germany) or SxlO-'^M GGP54626 (GGP, Tocris 
Bioscience, USA)) was bath applied to the brain after pre-treatment measurements. Measurements 
started 10 min after drug application. 
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Figure 2. Reliability of a temporally sparse code in the balanced cortical network. (A) 

Schematic of a two-layer model of sub-cortical and early cortical sensory processing. The afferent 
ensemble (blue) consists of 4,000 independent neurons, and each neuron projects to 1% of the neurons 
in the cortical network (green). The cortical network is a balanced network in the asynchronous and 
irregular state with random connectivity. In both populations black circles represent excitatory neurons 
and magenta circles represent inhibitory cells. (B) The distribution of firing rates across neurons in the 
cortical network is fat-tailed and the average firing rate is approximately 3Hz. (C) The distribution of 
the coefficient of variation (C„) across neurons in the balanced cortical network confirms irregular 
spiking. (D) Spike raster plot for a sample set of 30 afferent neurons (blue dots) and 30 excitatory 
cortical neurons (green dots). At t = (gray triangle) the stimulus presentation starts. (E) Population 
averaged firing for both network stages. The simulation (solid lines) follows the calculated ensemble 
average predicted by the adaptive density treatment (black circles). The firing rate in the simulated 
network is estimated with a 20ms bin size. (F) Number of spikes per neuron after stimulus onset 
{t = 0) for the adaptive network (solid lines) and the weakly adaptive control network (dashed lines). 
Cortical excitatory neurons (green) produced less spikes than neurons in the earlier stage (afferent 
ensemble, blue). The shaded area indicates the standard deviation across neurons. (G,H) Fano factor 
dynamics of the afferent ensemble in the network with strongly adapting neurons (G, — 110 ms) and 
in the weakly-adaptive (h, Tg — 30 ms) network, estimated across 200 trials in a 50ms window and a 
sliding of 10ms for the ensemble network with adaptation. The black circles indicate the theoretical 
value of the Fano factor computed by adaptive density treatment and shaded area is the standard 
deviation of the Fano factor across neurons in the network. (I) The Fano factor of strongly adaptive 
neurons in cortical balanced network reduced transiently during the initial phasic response part. The 
crosses show the adaptive cortical ensemble Fano factor for the case where the afferent ensemble neurons 
were modeled as a Poisson process with the same steady-state firing rate and without adaption. (J) 
The Fano factor in the weakly adaptive cortical network did not exhibit a reduction during stimulation. 



16 









Poisson 






Processes 






Receptor 


• 

• 
• 




Neurons 













Antenna I 
lobe 



Kenyon 
Cells 





500 1000 1500 

Time (ms) 



500 1000 1500 

Time (ms) 



B 



\ 



500 1000 
Time (ms) 



500 1000 1500 

Time (ms) 



-400 -200 200 400 

Time (ms) 



H, 







50 100 150 200 

Time (ms) 



Figure 3. Neuronal adaptation generates temporal sparseness in a generic model of the 
insect olfactory network. (A) Schematic drawing of a simplified model of the insect olfactory 
network for a single pathway of odor coding. Olfactory receptor neurons (OSNs, first layer, n=l,480) 
project to the antennal lobe network (second layer) consisting of projection neurons (PNs, n=24) and 
local neurons (magenta, n=96), which make inhibitory connections with PNs. PNs project to the 
Kenyon cells (KCs) in the mushroom body (third layer). (B) Spike raster plot of randomly selected 
OSNs (blue), LNs (magenta), PNs (green) and KCs (red) indicates that spiking activity in the network 
became progressively sparser as the Poisson input propagated into the network. (C) Average 
population rate of OSNs in the adaptive network (blue solid line) and the non-adaptive control network 
(dashed blue lines). The shaded area indicates the firing rate distribution of the neurons. The firing 
rate was estimated with 20ms bin size. (D) Average response in the antennal lobe network. PNs 
(green) and LNs (magenta) exhibited the typical phasic-tonic response profile in the adaptive network 
(solid lines) but not in the non-adaptive case (dashed lines). (E) Kenyon cell activity. In the adaptive 
network the KG population exhibits a brief response immideately after stimulus onset, which quickly 
returns close to baseline. This is contrasted by a tonic response profile throughout the stimulus in the 
non-adaptive case. (F) Effect of the inhibitory micro-circuit. By turning off the inhibitory LN-PN 
connections the population response amplitude of the KCs was increased, while the population response 
dynamics did not change. (G) Sparseness of KCs. The average number of spikes per neuron emitted 
since stimulus onset indicates that the adaptive ensemble encodes stimulus informatoin with only very 
few spikes. (G) Reliability of KCs responses. The Fano factor of the KCs in different network scenarios 
is estimated across 200 trials in a 100ms time window after stimulus onset. Network 1: (-l-)Adaptation 
(-l-)Inhibition, network 2: (-l-)Adaptation (-)Inhibition, network 3: (-)Adaptation (-)Inhibition, network 
4: (-)Adaptation (-l-)Inhibition. Both networks with SFA are significantly more reliable in their 
stimulus encoding than the non-adaptive networks. 



17 



A 1.0 

0.8 

Ll_ 

[I: 0.6 

■D 

£ 0.4 
I 0.2 
0.0 
-0.2 



B 



1.0 
0.8 
0.6 
0.4 
0.2 
0.0 
-0.2 




1000 2000 
Time (ms) 



3000 




1000 2000 
Time (ms) 



3000 



C6 

5 
4 

t 3 
2 
1 




1.0 
0.8 
0.6 
0.4 
0.2 
0.0 
-0.2 




1000 2000 
Time (ms) 



3000 




1000 2000 
Time (ms) 



3000 



E 2.0 

1.5 

0.5 
0.0 



1.0 
0.8 
0.6 
0.4 
0.2 
0.0 
-0.2 




1000 2000 
Time (ms) 



3000 




1000 2000 
Time (ms) 



3000 



Figure 4. Blocking GABAergic transmission in the honeybee changes amphtude but not 
duration of the KC population response. (A) Temporal response profile of the Ca signal imaged 
in the mushroom body lip region of one honeybee for different stimulus durations as indicated by color. 
(B) Temporal response profiles as in (A) in one honeybee after application of PTX. (C) Response 
profiles imaged from 6 control animals (gray) and their average (black) for a 3s stimulus as indicated by 
the stimulus bar. The responses measured in 6 animals in which GABA^ transmission was blocked with 
PTX (red) shows a considerably higher population response amplitude. The shaded area indicated the 
standard deviation of responses across bees. (D) Average amplitude-normalized responses are highly 
similar in animals treated with PTX and control animals. (E) Blocking GABA^ transmission with 
CGP in 6 animals (blue) again results in an increased response amplitude compared to 6 control 
animals (black). The shaded area indicates the standard deviation across individuals. (F) Average 
normalized response profiles are highly similar in the GGP-treated and control animals. 



